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Attorney Docket; 10559/634001/P12240 

Protocol Processing 

FIELD OF THE INVENTION 

This invention relates to protocol processing. 

BACKGROUND 

In many communication protocols, such as Transmission 
Control Protocol/ Internet Protocol (TCP/IP) , User Datagram 
Protocol (UDP) , (Internetwork Packet Exchange) IPX, Secure 
Sockets Layer (SSL) , Server Load Balancing (SLB) , and Extended 
Markup Language (XML) , data is sent from a source to a 
destination in the form of packets that pass along a 
transmission path established by the protocol. Flow control 
schemes can be provided to share the network resources among 
active transmission paths or connections. 

DESCRIPTION OF DRAWINGS 

FIG. 1 is a block diagram of a TCP processing system. 
FIG. 2 is a block diagram of TCP agents of FIG. 1. 
FIG. 3 is a flowchart for the TCP system of FIG. 1. 

DETAILED DESCRIPTION 

In general, in one aspect of the invention, a system 

includes a first agent, a processing agent for processing a 

protocol, and a second agent. The second agent is connected 
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to the first agent to receive and transmit events, and the 
processing agent has connections with the first agent, the 
connections transporting data between the first agent and the 
second agent and the processing agent transporting events to 
the first agent when the data being transmitted has been 
modified. The first agent is configured to monitor the data 
being transmitted to and received from the processing agent. 

Referring to FIG. 1, a connection flow control (CFC) 
system 10 includes two TCP agents 12 and 14 and three 
processing agents 14, i.e., processing agents 14a-14c. TCP 
agents 12 and 14 are processing entities in communication with 
a client 20 and a server 18 in a computer network system 5, 
respectively. Agents 12 and 14 implement the full TCP stack. 

Processing agents 14 are used to provide different 
functionalities from which network operators may choose. Each 
of the processing agents 14 includes a general central 
processing unit (CPU) system implementing a particular 
protocol function, with associated management and control 
features. For example, Secure Sockets Layer (SSL) protocol 
processing agent 14a is implemented to provide secure 
communications over the computer network system 5, and 
particularly, over the Internet. Server Load Balancing (SLB) 
protocol processing agent 14b is utilized to distribute date 
efficiently across different network server systems. Extended 
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Markup Language (XML) protocol processing agent 14c is used to 
assist in processing data in the XML data format. 

Processing agents 14 provide higher protocol level 
functionality, usually at protocol layers above TCP, for 
example, and are connected to the computer network system 5 to 
provide the higher- level functionality (Open Systems 
Interconnect (OSI) Level 5 (Session layer) and higher) . 
Processing agents 14 are implemented in hardware, such as with 
an application-specific integrated circuit (ASIC) , or in 
software. Communications and transmission of data among 
processing agents 14a- 14c are implemented in hardware as well. 
Each processing agent 14a- 14c is adapted to transmit and 
retrieve data packets 50 to and from the first agent 12 so 
that each processing agent 14a- 14c has complete control over 
what data it will receive and transmit. 

CFC system 10 provides a data transmission channel 2 8 
through which all data packets 50 are transmitted from first 
agent 12, through processing agents 14, to second agent 16 and 
client 20. CFC system 10 provides control channels 30a-30c 
for transporting control messages from each of the processing 
agents 14a-14c back to first agent 12. Control channels 30a- 
3 0c provide the control plane, through which ownership of data 
packets 50, for example, is moved between processing agents 14 
and through which events or control messages are exchanged. 
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Events are preferably of constant size, but should be 
flexible so that new types of control events may be developed 
as required. Events are not limited to that of passing 
ownership of payload data, but may be event notifications such 
as the notification of a timer expiration or a connection 
setup, for example. 

Generally, an event is a notification that a change is 
occurring that affects processing agents 14 receiving the 
event. For example, events may notify a transfer of ownership 
of a data (e.g., TCP) payload from processing agent 14a to 
another processing agent 14b. Events are the main mechanism 
for communication between processing agents 14 and are 
utilized for all inter-processing agent communication that 
requires an action from the receiving agent, e.g., first agent 
12. When an event is a simple event, such as passing 
ownership of a TCP payload, there would typically not be any 
control headers or fields in the data chunks, i.e., the 
essential data that is being carried within data packets 50, 
excluding any "overhead" data required to get data packets 50 
to its destination. For some of the more advanced events, 
such as a request to open a new connection, there may be a 
control header or field in the data chunk. 

CFC system 10 provides a control channel 26 between first 
agent 12 and second agent 16 for passing control information 
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27 from second agent 16 to first agent 12. Control 
information 27 includes a feedback mechanism such as an 
acknowledgment field in a data packet so the sender, i.e., 
first agent 12, can be made aware that the receiver, i.e., 
second agent 16, has received data packets 50. The control 
information 2 7 can also include various types of information 
to throttle first agent 12 into transmitting no faster than 
second agent 16 can handle the arrival of traffic of data 
packets 50. 

First agent 12 includes a TCP transmit window 22 and 
second agent 16 provides a corresponding TCP receive window 
24 . Flow control mechanisms such as Stop-And-Wait protocols 
implement an algorithm for flow control where a "sliding 
window" is used. The "window" is the maximum amount of data 
packets 50 which can be sent without having to wait for ACKs, 
i.e., control information 27 via the control channel 26. In 
particular, the operation of the algorithm is to first 
transmit all new data packets in the window, wait for control 
information 27 to arrive (several data packets 50 can be 
acknowledged in the same control information 27) , and then 
"slide" the window to an indicated position and re-set the 
window size to the value included in control information 27. 

Referring to FIG. 2, first agent 12 includes a controller 
40, which provides data channel 2 8 for data packets 50 
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implemented through an event queue system 3 5 (described 
below) . Data channel 28 and control channels 3 0a-30b are 
separated. Controller 40 provides a general storage of data 
with pointer semantics (i.e., requiring a handle or pointer to 
5 retrieve data therefrom) . Data packet 32 is preferably stored 
in controller 4 0 in data chunks, which is up to 2 KB each. 
Controller 4 0 may support larger data chunks which may be 
utilized for communication between processing agents 14. 
However, using smaller data chunks avoids complexity in 

5 5, 

^ 10 processing agents 14 . 

y A controller handle (not shown) is used to identify a 

Iff data chunk stored in controller 40. Therefore, when one of 

CP processing agents 14 has written a data chunk to controller 

P 40, a handle or token is returned to processing agent 14a, for 

m 

15 example. In other words, the handle is like a key to access a 
particular data chunk stored in the controller 40. When 
processing agent 14a desires to retrieve the data chunk, 
processing agent 14a generates a read command to controller 40 
with the handle as a parameter. However, there is no 

20 requirement that each data packet or frame on the network 
interface map onto a single data chunk. 

First agent 12 includes event queue system 35 which is 
integrated with first agent 12. Events are sent and received 
by event queue system 35, with events being delivered by 
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control channels 30a-30b to event queue system 35. Event 
queue system 35 includes an event writer 3 8 and an event queue 
34. When processing agents 14 transmit an event to first 
agent 12, it is preferably directed to event queue writer 38. 
Event queue writer 38 further directs events to event queue 
34. Although only event queue 34 is shown, two or more event 
queues can be associated with each processing agent 14a- 14b. 
Events within event queue 34 cycle through queues so that the 
events are processed according to the order in which they are 
received and/or by priority. 

In a sense, a queue of pending events for processing 
agents 14 may be viewed as a queue of pending tasks. When the 
processing agent 14 has completed a task and is ready for new 
processing, it retrieves an event from its event queue 34 and 
performs any processing required by that event. 

In certain embodiments, the size of an event is 
approximately 16 bytes, and some fields in the event may be 
predefined, while the remainder may be utilized by firmware 
for its own requirements. However, any suitable configuration 
of an event, including its size, may be utilized. The event 
may include an event type identification field (e.g., one byte 
long) to identify the type of the event. This field 
preferably exists in all events in order to distinguish the 
different event types. Some examples of event type 
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identification include: timer timeout, new connection setup, 
or connection payload. The event may also include a TCP data 
pointer field to point to the TCP connection the event 
involves. A handle field may be included with the event to 
refer to the data chunk stored in controller 4 0 to which it 
corresponds. An adjustUnitSize field is provided in an event 
to indicate the length and size of the data chunk, e.g., in 
bytes. A prefetch field may be included in an event to 
determine whether the data chunk, or part of it, should be 
prefetched by hardware before a processor processes the event. 

A flow control mechanism such as a "sliding window'' for 
avoiding queue overruns to prevent loss of events is 
implemented by TCP transmit window 22, preferably per 
connection. A data reader 3 7 reads data packets to be 
processed from TCP transmit window 22 and forwards data 
packets 50 to processing agents 14. 

The operation of CFC system 10 will now be described with 
reference to FIGS. 1-3. 

Referring to FIG. 3, a high-speed protocol data 
processing process 100 of the CFC system 10 is illustrated. 
TCP data packets 50, for example, are transferred through 
controller 40 (FIG. 2) . As mentioned above, the processing 
agents 14 manage the information in the OSI Level 5 (Session 
Layer) and higher. 

8 
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Protocol data processing process 100 transfers 
information between first agent 12 and second agent 16 via 
processing agents 14. After data packets 50 have been stored 
in the first agent, more particularly, in controller 40, 
5 protocol data processing process 100 begins by transmitting 
data packets 50 from first agent 12 to second agent 16. First 
agent 12 implements flow control mechanisms (102) such as 
sliding window protocols described above which can 
appropriately manage and control traffic of data flow through 

10 the data channel 28. First agent 12 keeps track of data 

packets being received and transmitted (104) from first agent 
12 to processing agents 14 . Data packet fields such as 
unitSize transmitted and unitSize returned from other 
processing agents 14 back to first agent 12 are monitored. 

15 After implementing flow control implementation and monitoring 
of packet data fields, first agent 12 transmits data packets 
50 to processing agents 14 (106) . 

When processing agents 14 receive data packets 50 (108) 
from first agent 12, processing agents 14 process the data 

20 (110) included in data packets 50. During processing of the 
data, certain fields of the data may be modified (112) . For 
example, the size of the data packet 5 0 may have been changed 
(114) . 
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If modifications have occurred in the data length or size 
of data packet 50, then processing agent 14a, e.g., generates 
a control event 30a (FIG. 1} to be sent to first agent 12 
(114) , informing first agent 12 of the modification in the 
data size. Upon receiving this event, first agent 12 places 
the event on event writer 38 and event queue 34 and performs 
any processing that is required by the event, such as updating 
data packet 32 and modifying TCP transmit window 22 
accordingly (FIG. 2) . First agent 12 again implements any 
necessary flow control (102), keeps track of data received and 
transmitted (104) and continues on to transmit data packets 50 
to processing agents 14 (106) . 

If no modifications occur during the processing by 
processing agents 14, protocol data processing process 100 
determines if additional processing agents exist (116) . If 
additional neighboring processing agents 14 are present, data 
is forwarded on to the next processing agent 14b (118) and if 
such data transmission is successful (12 0) , data is received 
(108) and processed (110) as described before. If 
transmission has been unsuccessful, protocol data processing 
process 100 passes control to first agent 12 to begin process 
100 again. 

If no additional neighboring processing agents 14 are 
present, data packets 50 are transmitted to second agent 16 

10 
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(124) . Second agent 16 receives data (124) and sends control 
information 27 via control channel 26 (FIG. 1) back to first 
agent 12 (126) . Second agent 16 also adjusts its TCP transmit 
window 24 prior to sending control information 27 to first 
agent 12. 

Various other processing agents 14 may be utilized to 
provide additional functionality to the computer network 
system implementing CFC system 10. Lower-level types of 
protocols may also be implemented in processing agents 14, 
such as a TCP termination protocol processing entity for 
terminating traffic from a server or a client in a network. 

Accordingly, the systems and methods described provide a 
modular system that allows a network operator to easily add 
new processing agents as required to provide additional 
network functionality and implement different protocols. 
Processing agents such as agents 14 with general processor 
execution standard software may be used with present systems 
and methods to implement higher- level (TCP and above) protocol 
processing. 

Other embodiments are within the scope of the following 
claims . 
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